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ABSTRACT 



" An instrument to help teacher supervisors in El 
Salvador to identify and measure good teaching was developed and 
tested. Because the .supervisors were, not trained as researchers, they 
needed an instrument that was simple to use as well as reliable. 
Several indicators were defined to distinguish between modern arid 
traditional teaching methods, for example the ratio of discussion 
time to lecture time, the ratio of opinion and thought questions to 
memory questions, the use of learning aids, and the amount of time ' 
spent by”students on projects of their owri choosing. These were 
measured on a classroom observation form made up o^^ 33 categories. 
Each category was divided into segments of class time-. The completed ■ 
form records the- number' oJf minuses the teacher spends at each 
activity — dictating, writing at the blackboard, reviewing individual 
projects, and the like. Approximately six hours w^re needed to train 
teacher observers to use the forms. . The- instrument was bested- and 
proved effective. (M3) \ “ / 
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Educational Reform Program of El Salvador, and 
especially its use of instructional television. 
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TEACHER OBSERVATION IN EL SALVADOR '' 



Introduction 




What constitutes, good teaching? This question has been 

asked, puzzled over, and debated throughout the history of education. 

’ ' " - ( ’ 

• • i 

Probably no two people would agree completely with any single answer, 
because^ education has many different goals and many different ways 
of achieving them. 

Why ,\ then, worry about what is gtfod teaching? / Why not be 
content simply to measure the results -- what the'T^dent learns and 
how he changes in the course of being taught? One reason is that we 
would like to know what kinds of teaching bring about different 
results. We would also like to know how best to train teachers. 

In El Salvador, there is yet another reason to worry about 
what is good teaching. The Ministry of Education is involved in a 
wide-ranging' program of Educational Reform. Its goal is to help 
teachers^ progress toward modern pedagogy, just as farmers, doctors, 
and managers are helped to move toward modern techniques and skills. 
The success of the Reform depends partly on school supervisors' 
to recognize and evaluate the changes occurring in their 
schools, so that where progress lags, they may help teachers make 
adjustments. 

The process by which supervisors developed an instrument to 

helfi,.them Identify and measure good teaching, and some of the findings 

% 

from that instrument, are described on the following pages. 



The Educational Reforcn and school suporvislon 

I 

The first phase of El Salvador * s" Educational Reform focused /^ 
the junior high school (grades seveni eight, nine). Its major 
components^ included the preparation of new curricula for all subjects, 
Introduction of instructional television, development of a new system 
of evaluating and promoting students, a full year’s retraining course 
for junior high school teachers, and a new and expanded system of 
school supervision. Previously, the school supervisor had functioned 
primarily as a fiscal officer and inspector; his new role was to help 
teachers adjust^ to the many changes occurring, and continually to 
stimulate improvement in the quality of teaching. 

During, the first year of "new supervision", we neglected to 
face squarely the problem of what "improvement in the quality of 

• • 7 

teaching" really meant. Consequently, after months of giving demon- 
stration lessons, and helping teachers plan classes and develop 
teaching materials, we had np concrete evidence that those efforts 

had been successful itr improving teaching methods. Subjectively, 

* * * • •“ 

conclusions were reached as to whether a specific teacher was using 
modern techniques or "traditional” ones ; however, there were no 
egreed upon criteria on. which to base those judgments, and there were 
frequent differences of opinion among the supervisors. 

After that experience, we decided that some standardized form 
for observing and evaluating teaching behavior was urgently needed. 

We felt that we needed some Instrument that would demonstrate not only 
ifferences among teachers, but also tl^e progress of individual teachers 
toward the adoption of modern teaching methods. 



/ 



VJe also recognized certain limitations ; Supervisors v;ere not 
trained as researchers; therefore, they required as simple an instrument 
as possible* In addition, because of the exigencies of their work, they 
needed a method requiring a minimum of training time to achieve relia- 

I 

bility, and one that could be rapidly tabulated. Above all, the 
instrument h^d to be of practical value to their work. 

In the United States, there have been developed some excellent 
instruments for describing the interaction between teacher and pupils 
in a classroom. The Flanders measures are an outstanding example. 

There are also numerous eval’.ative instruments, among them the IOTA 
(Instrument for Observation of .Teacher Activity) and the Robertson 
Teacher Self-Appraisal System. 

Good as these methods are, they typically demand highly expert 
observers who need a great deal of training. Further, they assume 
substantial interaction between teacher and students, and there is 
little such interaction in the classrooms- of El Sal\fador. We did not 
feel that they were the kinds of instruments that could be readily 
used by Salvadoran supervisors trying to help the teachers of their 
developing school system. 

consideration, we decided to develop our own' observation 
method, and while no model adequate to our needs was available, the 
guidelines for the method ultimately adopted were taken from C. E. 

V 
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®®eby s book. The Quality of Education in Developing (countries . 

eby s hypothesis is that developing educational sys^ms evolve' 

\ • . 

through four stages, and that the level, of ,general\education and the 






o 

ERIC 



4 



nnount and kind of. professional preparation of teachers is directly 
related, to thei.r stage of development. 

Briefly, at Beeby's first level of development, termed the 
"dame school" stage, most teachers are poorly educated and sketchily 

trained. Because the curriculum is vague (or nonexistent), the teacher 

' / 
is the sole authority of knowledge, and the students' school day 



consists of little but mechanica^drill, memorization, and choral 









recitation. 






Second is the ^age of Formalism, at which teachers are ill 
educated but trailed. Authority is centered in. the official program . 
of studies , ana the teacher lacks th^self-cqnfldence to adapt that 

j' ' * • . 

programme the interests and leeds of his students. Most of the 
quMpdbt\s asked by the teacher have a single correct answer. The 
tudent continues to serve largely as a passive receptacle for 
knowledge poured into hi|n by the teacher. , 

At the Transiti'on Stage, teachers are better educated than 
at Stage TWo, and they are better trained. TVte program of sCudies- 
is followed less rigidly, and students learn that not all the answers 
ore contained in the syllabus. The teacher's professional training 
Increases his self-confidence, prompting him to introduce activities ' 
of*his own invention and to enrich the school day with special projects 
and audio-visual aids. Students are active participants in the learning 
process, and they ask questions and bring their own experiences into the. 
classroom. v • 

The Stage of Meaning has well-educated,^ well- trained teachers 



5_ 

who encourage- students to think for themselves. The learning process 
is individualized to relate to the needS) ^interestSi ard abilities of 
students. Much, time is devoted to projects | problems} and exercises ' 
chosen by the s.tudents themselves . * 

Beeby*s theory of educational development is pertinent to 
LI Salvador. Here the majority of secondary teachers have 11 years 

of general education; their professional preparation occurs at either 

/ 

the high school or junior college level (in rare instances, at the 
university), and ror the majority it is the high schoo}., level. As ' 

might therefore be expected, prior to the Reform, their teaching 
style reflected Beeby's second level of development; the\Stage of 
Formalism. 'Cae official program of studies was rigidly adhered to. 
Teaching cons is ted ^mainly of lecture and dictation, and the student's 
role was to memorize what. v;as said by the teacher in order to reproduce 
it verbatim on examinations.. 

The- Educational Reform seeks to change this situation. One 
means of change is through the new curricula. The previous programs 
of study contained long/lists of unrelated facts to be memorized; the 
new programs are concept-oriented, emphasizing understanding and 
applying concepts rather than remembering facts. The new programs, 
unlike the old, also include methodological suggestions to aid teachers 
in planning their classes. 

.. 

Further encouraging student participation, the Reform has 
de-emphasized written examinations in favor of the eyaluation of 
various other student activities, such as reports, essays, dramati- 
zations, investigations, experiments, map-making, etc. 

.8 
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The Reform also introduced instructional television as a means 

- :• . \ 

to enrich the students* school day with information and experiences ^ 

otherwise unavailable in tneir own classrooms and communities* In 

addition, it v/as hoped that the tcleteachers would provide models of 

good teaching, that could be emulated by classroom teachers* 

To help^eachers prepare for change, a new normal school was 

organized to provide a full year's retraining. Courses provided dealt 

... ... *. 0 
with the content of the new curricula, evaluation techniques, guidance, 

the utilization of instructional television, the preparation of audio- 
visual materials, the organization of school libraries, and methodology. 

Believing Beeby's typology relevant to El Salvador's developing 
school system, ,we felt it could provide the guidelines for our obser- 
vation instrument. "However, while Beeby describes the path of change, 
he does hot indicate how progress along the path can be measured. Our 
task was to devise a simple means of measuring that progress through ' 
observable classroom behavior. How could that be done? J 

Drawing on the supervisors' experience, we found it relatively 
casy^io characterize "traditional"'-- pre-Reform -- teaching in 
bchayioral terms. "Traditional"^teaching involves only a few different 
kinds of behavior: Thfe teacher lectures and dictates for nearly the 
entire class pe:^od; when he asks questions, they are nearly all of 
the memory (single-answer) type; he depends heavily on the blackboard 
to write resumes and exercises for students to copy; students almost 
never ask questions, give opinions, or otliervjise participate in class 
except to copy or "recite". 
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Given\^ese characteristics of the "traditional" classroom, 
we then asked ourselves what observable changes we expected to see 
as the Reform spredd through the schools. 

We decided that the following items of beKayior could help 
us determine'^a-^clasaroora' s level of development: 

Teacher lecture and dictation: As a classroom develops, vie— - 
supposed that dictation wou3.d gradually disappear and-'lecture time 
diminish, while the proportion of studen^tallTaiitr^ctivities 
Increased. _ 

Teacher ques t iorr^ ; The kinds'^of questions asked by the 
teacher' should be an Important u'casure of development. .As a classroom 
progresses, the proport'^^' of opinion and thought questions (multiple- 
answer) to memory questions (single-answer)-'Should increase. By 

memory questions we mean those with a single correct answer (What 

■ ' ■ / 

are the seasons of the year? Who was the first president of El 
Salvador?). Opinion questions are those relying more on point of 
view than logical thought,- but 'which permit a variety of correct 
responses (How might you make a prose version of this poem? What 
do you think of this play?)* Thought questions are those requiring 
students to make deductions, comparisons, generalizations, etc. (Is 
^bis a lyric or an epic poem -- why? Why are these triangles equal?. 
IThat formula can you deduce from this exetciseL?) . 

Use of learnin g aids ; In the early stages of development, a 
syllabus dr text and the blackboard are likely to be the only learning 



aids u$f.ed* As a classroom develops, other learning, aids. ••• pictures, 
• charts, maps, demonstrations -- should begin to appear. Their use 
should increase with further development, until finally learning aids 

* I . i » » 

arc individualized. ^ 



Instruction : As a classroom moves upward,' a 

» ■ 

portion of vthe teacher's time should begin to jbe devoted to directing 
group exercises and -activities, and to heTpin^ individual students, ^ 



With further development, these activities should gain importance. 

Homewo rk assignments ; As a classroom progresses, the teacher 

... , ‘ / 

should increasingly assign hoaiev7ork that requires investigation and 
reasoning by students. 



Student questions; In the first levels of development, 
students ask few, if any, Questions. Most oi'-^those they' do ask 
involve classroom procedure (what are we supposed to do?). As a 
classroTom progresses, students should begin to ask some clarification 
questions .(what do^s this mean?) and then th^ght questions (what 
would happen if -. As development continues, thought questions 

should predominate. 

Studen t talk ; In the "traditional" classroom, students rarely 
venture an opinion without being specifically asked for it by the 
teacher. As a classroom moves upx,7ard, we expect more opinions to be 
volunteered by students, and some discussion 'among students to occur. 

As development continues, both activities should increase dramatically. 
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Small group and indi vidual work ; In the earliest stages of 
development, group work is nonexirtliTt , and the individual work done ’ 

. by students is mechanical (practicing mathematical, operations , copying 
from tc»c blackboard). .As a classroom de^lops, occasiprial group work 
should occur, and 'the individual work' asslLghed“7tudent^^^^^^ class 

•should, require more thought and investigation. Farther along the - 
development p^h, students should spend an increasing amount of time 
working on projects, /problems, and exercises of their own choosing. / 

, ' . ' -• ■ /■' ' ■ '' ■ ' ■■ • 

The observation form 

The sample observation form (translated from the Spanish) on 
the following page illustrates .the items of behavior selected for 
observation. A. few items pertinent to supervisors' work but not 
necessarily related to. development are also included. These are the 
three items on the student half of, the form labeled "Repetition 
drills’’, "Question-answer drills", anrV "Dramatizations". 

Included, for observing foreign language (English) , teachers; 
retraining course included techniques of oral-aural languige instruc- 
tion, - To <t£tnd- out whether teachers were' applying. those t 
these items were added to the form. .' 



They were 

whose •• 

\ , 



: ichnlques. 



it is apparent that not all of the possible classroom 
activities were selected for observation. Other possibljlities -- the 
teacher's ability to maintain interest, his knowledge the subject 
oatter, his ability to relate a topic' to the students'^own ehvlronment 
and experiences -- were purposely excluded as being top difficult to 




11. Uses audio-visual inatoaOjil s. • , ' 21. Student behavior during Teleclass: 



measure. Also, it was felt ;thaf those activities selected for obser- 
vation were adequate for supervisors' needs. 



How to record observations . 

Once- the activities to be observed were selected, the problem 
was to devise a simple means of recording their occurrence in the_ 
classroom. We decided to build our form on a time basis. As seen 
pn' the sample form,, beneath, each activity is a line of five boxes: 



1. Lectures 



5' 



Each individual box ( QQ ) represents five minutes of class \time. 
During ‘the first five-minute observation period, the observer marks 
the first box of every activity engaged in by both teacher and 
students. For example, let us suppose thjat during the first five 
oinut.es . observed the teacher began by lecturing for three minutes 
on a new math formula. He then asked a' student where the chalk was, 
spent a minute writing problems concerning the new formula on the 
board, and afterwards directed students to solve the problems in 
their notebooks. For those five minutes, the observer would have 
marked the following items in t^is way: ' 



12 
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^ACHER: 



■1. Lectures 



" 



I . 



4. Asks procedure questions 



9. Uses blackboard 



STUDENTS: 



8. Work individually 



0 



As will^b6 noted, for those activities requiring an accurate 
time measure (Lectures, Uses blackboard, etc.), each five-minute box 

is subdivided into one-minute segments. In cases where frequency is 

/ 

more important than duration (Asks procedure questions, etc.), the 
observer marks each Separate occurrence. It is also worth noting 
that, in the above example, had the teacher continued, to lecture at 
the same time he was writing on the blackboard, the form would have 
been marked as follows: 



15 
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1. Lectures 






V 



9. Uses blackboard 



Observations are recorded in the same fashion during each of 
the four remaining five-minute periods. 

In any given 50-minute class period, observations are recorded 
for only half that time. It was decided to do this to obtain e«i}uivalent 
obser\faXion time in television and non-television classrooms. In 
classes with television, the first 10 minutes are taught by the class- 
room teacher, the teleclass consumes the next 20 minutes, and the final 
20 minutes are again taught by the classroom teacher. Being primarily 
interested in the classroorn- t^’her, the-supervisors decided not “to " 
record behavior during the 20-minute teleclass. In a classroom with 
television, observations are recorded for the following five-minute 
periods; 



8:00 - 
8:05 - 
8:10 - 
8:30 - 
8:35 - 
8:40 - 
8:45 - 



05 -- no recording 

10 -- first box 

30 -- teleclass (no recording) 

35 -- Second box 

40 — third box 

45 -- fourth box ' 

50 — fifth box 



In non-television classes, observations are made by alternating, 
five minutes of recording with five minutes of non-recording throughout- ^ 
the 50-minute class: 
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8:00 - 
8:05-^- 
8:10 - 
8:15 - 
8:20 - 
8:25 - 



05 /- ‘no recording 
-10— -- first box 
15 --no recording - 
20 -- second box 
25 -- no recording 
30 -- third box 



ETC. 



ETC. 



In prjictice, alternating recording periods in this manner presented 
no problems. Ti^enty-five minutes seems sufficient to record all 
significant classroom behavior. 



Training observers 



/ 



The first step in training obsetvers was to familiarize, them 

\ ■ ' ' 

thoroughly with the meaning of each item'on the observation form. 

Once this was done, they were instructed in the mechanics of recording 
observations. Several, five-minute segments of video-taped clasps T” 
were then viewed, vjhile observers ,pra(/ticed recording activities on 
'the 'form. Difficulties and uncertainties were discussed whenever they 
occurred, until all the observers learned to mark the form in the same 
way. These steps required approximately two hours' tra^ining time to 
achieve inter-observer reliability. ^ * 

The remaining four' hours of training were spent achieving 
reliability on question classification. Video-taped claves were 
again viewed and written samples of questions taken from various 



-classrooms were* discussed. 



./ 

/ 



Two separate observer groups (six members) attained 90 per 

■ 1 '■ 

cent or more inter-observer reliability on all items, in six hours. 
On the other hand*, when we tried to train~'larger groups (18 members) 



15 



lescope the training into three hours, we did not achieve 
e reliability. Our conclusion is that six hours .is the * 
minimAra adequate training time, and that reliability is more' easily 

V. ■ • 

achieved with small groups (two to six members) than large ones. 
Tabulating observations 



and \to te 



acceptabl 



Tabulation of the form is a matter of employing simple addition 
and a few ratios or percentages. It can be easily and quickly .done by 
the observer himself. The' de.scriptive nature of the form provides the 
observer with a.graphic picture of classroom. activity that is readily 
apparent even without tabulation. 



Tssting che validity of the observation form 

Sixteen eighth-grade teachers were randomly selected for a 
series of observations by a single observer, Ihose selected were 
chosen from two distinct groups of teachers: one group (New System 
teachers) that was included in the Educational Reform programs, and 
one group (Old System teachers) that was not yet affec^ted by the 
Reform. In this way, we hoped not only to test our form's validity, 
but also to find differences in development between the two groups 
of teachers. The New System group included television classrooms 
and non- television classrooms , identical in evety way except that 
teachers in the latter group did not use instructional television. 



The Old System classrooms had no television, of course, and the 
teachers had not been retrained. The diffefenc^es in the three groups 
are Illustrated belowVy^ 



i^rafifcAliiWKAiL ■; VnjfrAV’iihf trir 'ilM ir‘ 
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( Educational Reform Programs 







One year's 
retraihine 


1 

New Curricula 


: Guides and 
VJorkbooks 


! TV 


New System 
teachers 


television 

(6) 


> 

YES 


YES 


1 

j ■ 

i YES 


! 

i 

1 

Iyes 


New System 
teachers 


non-television 

(4) 


YES 


YES 


1 

! 

i YES 


NO 


Old System 


teachers (6) 


* ’! 

NO ; 


1 

I NO 


1 

i NO 1 


NO 



Each teacher' was observed on three different occasions over a 
six-week period, and no teacher was advised of the day or time he would., 
be observed. 

**■ 

/ Results of the study 

A complete tabulation of the observations recorded in all 16 
classrooms is appended to this report, l^at follows is a summary of 
the -most significant figures (see Table 1): ; 

OL^ System teachers di r! tated s ix times as much as New System 
teachers. Of the 25-minute, observation period, Old System teachers 
dictated an average of over five minutes per class,'' while New System 

teachers spent less than one minute per class dictating. This means 

./ 

that the average Old System teacher spent over 20 per cent of the 
. observed class time reading from a book while students copied 
verbatim what was read. ' 



I . 

Three of the Old System teachers had received a seven-week 
f J^etraining course, but none had attended the full year's course. 



/ 
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New System teachers asked more than twice as many mul tiple- 



Answer . questions as Old System teachers . Old System teachers asked 

\ 

only three multiple-answer questions per qbseryed class; New System 

4 

teleyision and non-teleyision teachers asked seven and six per class, 
respectiyely . Eyen more important. Old System teachers ayeraged only 



on the other hand, averaged at least one thought question per class. 

Several different types of learning aids were utilized in New 
System classes . while not one Old System teacher used any learning 
aid except the blackboard. The learning aids used by New System 
teachers included demonstrations, slides, charts, maps, pictures, 
diagrams, etc. Television was not counted among the learning aids. 



classes, student participation of this sort was so rare that it 



the six Old System classrooms, students never volunteered an opinio;:. 
On the other hand, students in New System classes ventured opinions 



classrooms . It did not occur in non-television or Old System classes. 



one thought question for jevery 10 classes observed ! This means that 



only once every two weeks woulB students' in Old Systetn. classes be 
asked a question that required them to reason. "New System teachers. 



Students volunteered their/ own opinions much more frequently 
jjl Nev? System classes than in Old System classes . In Old System 



occurred in only one of every five classes observed ,- and in four of 



at least once in every class, and in no Nev/ System classroom did- 
students fail to give at least one opin luring the three 




obseryations. 



Student work in groups was observed in several tclRvision 



21 









7 



1 












19 



Group work was defined as the Interchange of ideas among a small group 
(four to six members) of students for the purpose of arriving at con- 
clusions, solving problems, writing reports, etc. It did not refer 
simply to placing students physically in groups. 

Student individual work was observed almost twice as frequently 
In 01^ System and non-television classrooms as in television classes . 
However, this is accounted for by the fact that teachers with tele- 
vision devoted nearly the same amount of time to group work as they 
did to individual work. Only half the Old System .teachers used 
individual work, but those that did relied heavily on it, using it 
between 25 and 100 per. cent of the observed time in all their classes. 
They also demonstrated the tendency to interrupt the students 
frequently to lecture , with the result that some students would 
suspend their work to listen to the teacher while others would j 

ignore the teacher and continue to work. The New System teachers 1 

interrupted in this way much lesa frequently. In ail cases of ^ 

individual^ work, the tasks involved were largely rote. 

As is apparent, there was little difference between the 
television and non-television classrooms in the New System, but 

considerable difference between the methods of teachers in the New 

% 

System and those in the Old. Therefore, it is. reasonable to assume 
that the differences in observed classroom behavior arc related to 
the retraining -course , the new curricula* and phe* new teachers' 
guides, rather than to the presence of television in the classroom. 
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FIGURIC ONE 

Additional comparative data on classes oC different kinds 
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Learning results fvom the classes observed 

' ^ ' 

Achievement scores of students in all 16 classrooms observed 

^were obtained for social studies, mathematics, and natural science. 

While pupils in both the television and non-rtelevision New System. 

classes gained noticeably more than students in Old System classes, 

we do not feel justified in generalizing from the results. (See 

Appendix 2.) The number of classes was small, we are not certain 

that pupils were assigned randomly, and there may be uncontrolled 

and even unknown variables operating to affect learning gains. 

However, New System ‘teaching methods seem, to prove out, 

although we are not sure whether the/^achievemeiit gains should ^e 

/ . ■ , ! 
credited to the teaching, tSe net^ curricula, or to the ^ new guides 

and workbooks. On the basis of our evidence, it is impossible to 

/ t ^ 

determine which factor is salient. A better experimental'i^design. 

will be necessary to judge that. 

^ Comparing achievement gains for classes in the same group • 

(e.g., New System' televi^on or non-television or Old System) j no 

’ s / , ■ ■ 

significant patterns of /relationship between learning gains arid 

teaching styles were apparent. Again, it must be remembered that 

/ 

we were working with a very small sample. 

* / ■ 

/ ■ ■ ' 

Results of the study and Beebv^s typology " 

/ 

/ . _ . _ . * ■ 

It will be recalled that Be'eby's hypothesis is that the 



From exami^tions based on the El Salvador eighth-grade 
curriculuoi, preparedly the Educational Testing Service, Princeton, 
New Jersey. 
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and training of teachers is directly related to their level 
of development. Teachers in his First ("Dame School") Stage are 

57' ’ V j 

poorly educated and little trained, l/hen teachers have some training - 

» A , 

~ ^ \ 

in their craft, they' tend to mdve into Stage Ttvo ("Formalism"), where 
they closely follow the official syllabus. When they are better 
educate'd and better trained, they move into Stage' Three ("Transition"); 
' and by Stage Four ("Meaning"), teachers are both well educated and 
highly trained. “ - 

AII.^nIS Sjlvadoran teachers observed in this study would 
probably be ^lassified’in Beeby ' s second stage. We obtained the 

r ■ 

schpoi records of all 16 tcache.rs, and found no significant corre- 
^.iations between their levels of e<Jucatibn and training, and their 
claissroom performance as measured by our instrument -- as long as 
education, and training were counted, as years in s'chool and years in 
teacher-training institutions. Indeed; some of the Old System teachers 
had received more schooling and more advanced training than many of the 
^ Mew System teachers who performed in a more modern pedagogical pattern. 

The one significant difference in their background was the 

/ ■ ^ * 

year of retraining included in the Educationa.l Reform. All New System 
teachers in the sample had received this training, while the Old System 
teachers had .not. , 

As stated earlier, the retraining course was both substantive 

, a 

and methodological. Teachers were instructed in the subject matters 
they would teach’, and also in the newer methods they were expected to 

use. Thus, they had both education and training that the Old System’ ’ * 
teachers did not have. . 
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li/hy should a single year make such a difference? The Old 
System teachers apparently were not taught newer methods of teaching 
in their teacher~training schools^ nor were they .taught-,-.apparcntly , 

y ' 

much about the new mathematics, the new science, or the Salvador- 
centered social studies • Further, they were taught in the **tradi- 
tional” way, and teachers typically teach as they are taught. 

We feel strongly that these results should not be interpreted 
as failing to confirm the importance of general education and teacher- 
training in the modernizing of teaching behavior. On the contrary, 
they should be seen as evidence that, if teachers are ,, expected to use 
moderh methods, they first must be shown those methods and be allowed 



to practice them. 

Fuijthermore , it must be remembered that we were not observing 
the whole range of Beeby's four stages, but rather teachers within a 
single stage. In the near future, we plan to observe some teachers 
elsewhere who would probably be classified in the Third or Fourth 

see how their performance compares with teach'ers^bs^rved 
in El Salvador. That will give us the opportunity to test Beeby's 
typology better. 
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Implications of the study for the Educational Reform ! 

The Educational Reform is clearly succeeding in introducing 
some techniques of modern pedagogy into the classrooms of El Salvador 
In Beeby's terms, the results demonstrate the movement of Salvadoran 
schools from, the' Stage of Formalism . (Stage Two^/ toward the Stage of 
Transition (Stage Three). 



Howeve^, the results also suggest that describing development 
in terms of four 'separate stages may not fully reflect the development 
* process. Hie classrooms of El Salvador do not seem to be taking one 
giant step from Stage Iwo to Stage Three. While all 16 teachers 
observed are in Beeby's Second Stage, they are clearly at different 
levels wiithin that stage. Development can certainly occur within any 
single stage, as well as from one stage to its successor. Progress 
seems to occur in tiny steps, and it is slow and uneven. 

/ One example of this is that certain aspects of modern peda;^bgy 
student discussion, students' asking of thought questions, teacher 
aid to individual 'Students extremely rarely or never occurred in 
the (glasses observed. Other aspects of modern teaching -- the use 
of learning aids, the asking of thought questions by the teacher -- 
were employied, but less frequently 'than one would have hoped. 

In any case. New System teachers seem to be moving toward the 

non-rote, individualized, problem-solving learning that is the goal 

/ 

of the Educational Reform. And when all the small changes 'are totalled 
the sum. is impressive. By the same token, changes that are numerically 
*m 11 may, in fact, be greater ones than the numbers suggest. For 
example, it seems to us that, when compared to an Old System teacher 
^ho asks thought questions, the New System teacher who asks even 
^?tA4£hL3.M®s.tion-per'Class^has "changed more significantly than the 
‘•inference between "zero" and "one" suggests. Stimulating the adoption 
a previously nonexistent behavior is probably much more difficult 
increasing the employment of a behavior already in use. 



. ?5 . 

While the various programs of the Educational Reform have 
functioned in concert to produce the changes occurring in El Salvador's 
classrooms, it would appear that the program of teacher retraining has 
been particularly effective. Were Lt not providing a model of desired 
classroom behavior, we believe that progress, as measured by our 
observation instrument, would be far slower and less evident than it 
is. ' 

This belief is strengthened by the fact that half the Old 

System teachers in our sample had received far more general education 

i 

and advanced teacher-training than all but two of the New System 
teachersy^ut none of the Old System teachers had received a full 

I * 

year s retraining. That fact casts doubt on the notion that previous 
advanced training and education, coupled with ninimal retraining, can 
be counted on to produce changes in classroom behavior. From_our- smpll 
sample, we cannot be certain of this, but the problem definitely merits 
further- study and a reexamination of assumptions regarding the length 
of retraining required for teachers with advanced professional training 

However slowly and unevenly , changes are certainly occurring 
In Salvadoran schools. However slowly, and perhaps tentatively, 
teachers are certainly changing their classroom behavior. To insure 
that such change continues in the desired direction is the function 
of the school supervisor . 



It will be recalled that three Old System teachers had 
received seven weeks* retraining. ^ 
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Implications for future use of the observation form 

The study conducted showed us. that the observation form 
taeasured what we intended it to measure. It was easy to use and 
quickly tabulated. Above all, the study indicated the form's prac- 
tical value to supervisors. 

From the first, v;e felt that supervisors needed an instrument 
that would demonstrate the progress of individual teachers toward the 
adoption of modern teaching methods. Ue. wanted to be able to pinpoint 
the specific areas where progress lagged. 

The-ro^m seems to meet those requirements. The results made 

it' possible both to assign each teacher a general level of development 

• < 

and also to note the precise areas in which each needed assistance to 
improve his performance. 

We consider it very important that the form will orient super- 
visors to deal with very specific aspects of teaching behavior. . The 
supervisor's task need no longer be the impossible one of "improving 
the quality of teaching." Rather, the form will help us set more 
limited and more easily attainable goals -- "increasing the number 
of thought questions", or "decreasing the amount of dictation". 
Improving the quality of teaching is still the end result. 

Limitations of the observation form * 

While We are generally satisfied with the form as it stands, 

we recognize a number of important liraitations. First, no affective 

^ / 

behavior is included, meaning* that such teacher behavior as praise. 
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encouragement, and criticism cannot be recorded. This type of behavior 
is certainly important, but v.’e feel it is too difficult to measure, at 
least for the present. . . ■ . 



Also absent from the form are some important quality distinc- 
tions. The form indicates, for example, whethop individual or group 
work is engaged in, but not the type of work. There is an important 
difference- between work that requires only' copying and recall 'and 
that which demands thoughtful investigation and reasoning. We hope 
in future revisions (the current form has gone through four revisions) 
to correct this deficiency. 

We also feel that the categories cf question classification 
are by no means perfect, tor example, the procedure question category 
currently refers to both procedural (where is the dictipnary?) and • 
rhetorical questions (we represent altitude with an "h", don't we?). - 
We now feel that rhetorical questions should not be recorded, and we - 
will not do so in the future. 

The memory question category is clear-cut, but the difference 
between opinion and- thought questions is not. Both have multiple, - 
rather than single, -answers, -and it is not always easy to distinguish 
betweea the two. To make sharper distinctions, however, would require 
creating many more categories of questions (some authors on the subject 
identify as many as 26 different types of questions). For the present, 

, simplicity seems preferable, although we would, like in the future to 
devise more clear-cut categories. ' *' 
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Despite the limitat;ions, the current form meets our basic 
needs. It is not a perfect instrument, but it will certainly help us 
identify and evaluate the changes occurrihg.in the schools, so we may 
provide the kind of._help that is most needed. 
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